Network Considerations

Coherence cluster members may be split across multiple switches, and may be part of multiple subnets such topologies can increase network latency on cluster communication by an order of magnitude. Typically, impact is realized as communication delays that affect cluster performance. If possible, consider locating all cluster members on the same switch and subnet to minimize network latency.

10GBE Considerations, if higher network interface is being used Many 10 gigabit ethernet switches, network interface cards support frame sizes that are larger than 1500 byte ethernet frame standard. UDP socket buffer sizes of 2mb, 4mb, 8mb are selected for MTU (Maximum Transmission Unit) sizes of 1500 bytes (standard), 9000 bytes (jumbo), over 9000 bytes (super jumbo) respectively. Make sure to increase the operating system socket buffers to 8MB for larger sizes. If a Warning: is issued in the log. Generally, for standard MTU 1500 bytes, on Linux the socket buffer size must be set to 2mb, usually on linux default socket buffer size is low, windows has much higher.

On Linux (as root) - Socket Buffer Size, for network data-packets of size 2mb over 1500 bytes standard MTU interface card:

  • sysctl -w net.core.rmem_max=2097152

  • sysctl -w net.core.wmem_max=2097152